OpenAI
Sep 11, 2026
Rapidly scaling online storage to serve over 1 billion ChatGPT users
OpenAI describes Habitat, its shared online-storage service, as handling more than 70 million requests per second across nearly 40 regions and more than 500 petabytes of data. The engineering account explains the move from a client library to a centrally controlled service, tail-latency and connection-pool fixes in the Python implementation, and a subsequent Rust rewrite now serving 95% of production traffic.
- OpenAI reports that Habitat handles more than 70 million requests per second, supports products used by more than 1 billion people weekly, and serves more than 500 petabytes.
- OpenAI reports that two engineers using Codex and GPT-5.5 rewrote the service in Rust in Q2 2026.
- OpenAI reports 6x CPU efficiency and 15x memory efficiency versus the Python service, with the Rust version handling 95% of production requests.
Why it mattersThe post offers a rare operating view of the storage and reliability costs behind billion-user AI products. It also illustrates where model-assisted code migration can change infrastructure economics, although the reported efficiency gains are OpenAI's own production measurements.
Salesforce
Sep 11, 2026
Salesforce Introduces the Trusted Enterprise AI Harness
Salesforce presented an Enterprise AI Harness that packages shared context, agent orchestration, actions, governance, security, and model access behind a composable architecture. A planned AI Control Plane is intended to give enterprises one place to observe and govern agents spanning Salesforce and third-party systems.
- Salesforce describes six shared capability layers covering context, agency, action, governance, security, and models.
- Salesforce says the architecture can incorporate third-party models, agents, and systems.
- The announced AI Control Plane is intended to centralize management and oversight as agents proliferate.
Why it mattersThe announcement reflects enterprise AI competition shifting from standalone copilots toward control planes that bind agents to data, permissions, and business workflows. It is a product roadmap from Salesforce, so adoption, interoperability, and operating results remain unproven.
Anthropic
Sep 10, 2026
Detecting and countering misuse of AI: September 2026
Anthropic's latest threat-intelligence report summarizes cases it says it detected and disrupted between December 2025 and August 2026 across cyber operations, influence and surveillance, scams and fraud, biological and weapons misuse, and model distillation. Its central operating signal is a shift from isolated assistant use toward persistent, multi-agent orchestration across longer attack workflows.
- Anthropic says the report covers malicious activity it disrupted between December 2025 and August 2026 across seven harm areas.
- Anthropic reports observing more persistent and orchestrated uses of AI across cyber-attack workflows.
- Anthropic states that the published cases are notable examples and should not be read as typical misuse prevalence.
Why it mattersFinancial institutions and other critical-infrastructure operators need controls that monitor whole agent workflows, credentials, memory, and tool execution rather than judging prompts in isolation. The cases and actor attributions are Anthropic's assessments, not independently adjudicated findings, and the company says they are notable examples rather than representative prevalence data.
NVIDIA Research
Sep 10, 2026
How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra
NVIDIA reports that NIM 2.0.12 raised Nemotron 3 Ultra output throughput from 718 to 1,997 tokens per second at a 50-tokens-per-second-per-user target on four B200 GPUs. The stack combines tuned kernels, tensor parallelism, prefix and state reuse, scheduler and memory changes, and speculative decoding.
- NVIDIA reports 1,997 output tokens per second for NIM 2.0.12 versus 718 for its baseline at the stated interactivity target.
- The benchmark used four B200 GPUs with a 64K/400 token workload, 76% KV reuse, and a 50 TPS-per-user target.
- NVIDIA recommends replaying representative production traffic rather than generalizing from the single benchmark point.
Why it mattersServing-stack optimization can materially change accelerator utilization and per-user inference economics. The 2.5x headline is a vendor benchmark for one specified 64K-prompt, high-KV-reuse workload, so capacity planning still requires workload-specific testing.